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ABSTRACT 


i 
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Likelihood  ratio  tests  for  the  problem:  H  :  F  c  <^t  versus 

o  1 

Hji  F  ec^-c?j'  are  defined  for  certain  nonparametric  families 


of  distributions  and 


In  particular  the  likelihood 


ratio  test  is  defined  and  shown  to  be  unbiased  when 

denotes  the  exponential  distributions  (possibly  truncated) 
and  oT  denotes  the  distributions  with  increasing  failure 
rate.  Comparisons  are  made  with  competing  tests.  The  problem 
of  testing  for  increasing  failure  rate  average  is  also 
exam i ned . 
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LIKELIHOOD  RATIO  TESTS  FOR  RESTRICTED  FAMILIES 


1 .  Introduct ion 

Tests  for  composite  hypotheses  having  optimal  properties  for  finite  samples 
have  been  obtained  for  various  special  problems  by  an  important  principle  due  to 
Neyman  and  Pearson  (1928,  1933)  called  the  likelihood  ratio  principle.  This  principle 
leads  to  the  likelihood  ratio  test.  Asymptotic  properties  of  this  test  for 
parametric  families  of  distributions  can  be  found  in  Wilks  (1962).  Recently 
a  conditional  likelihood  ratio  test  has  been  proposed  for  testing  for  trend  in  a 
stochastic  process  of  Poisson  type  (Boswell  (1966)].  This  is  a  departure  from 
the  standard  literature  in  that  the  underlying  family  of  distributions  considered 
is  essentially  nonparamet r  ic .  The  main  result  obtained  is  the  asymptotic  distribution 
of  the  likelihood  ratio  under  the  null  hypothesis  of  no  trend. 

We  consider  likelihood  ratio  tests  for  certain  geometrically  restricted 
families  of  distributions.  For  example,  let 

<5^  =  |  F  |  F(0)  *  0  and  3  nondecreasing  in  x  >  0  j  . 

Then  is  known  as  the  IFRA  (for  increasing  failure  rate  average)  family  of 

distributions.  These  distributions  play  an  important  role  in  the  mathematical 
theory  of  reliability  [Birnbaum,  Esary,  and  Marshall  (1966)].  However,  not  only 
is  the  family  nonparamet ric  but  there  is  no  sigma-finite  measure  relative  to  which 
all  Fee?"  are  absolutely  continuous.  Hence,  the  usual  concept  of  maximum 
likelihood  estimate  does  not  suffice.  Kiefer  and  Wolfowitz  (1956,  p.  893)  propose 
a  generalization  of  the  maximum  likelihood  estimate  concept  which  we  adopt.  Let 
Fj  ,  Fj  €e*~and  let  f ( • ;  F^  ,  F^)  denote 


the  Radon-Nf kodym  derivative  of  Fj  with  respect  to  the  measure  induced  by  F^  +  F 


r 


L 
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Definition  1 

A  A 

F  is  called  the  maximum  likelihood  estimate  relative  to  if  F  satisfies 

n  f  f(X. ;  F,  F)  ] 

Sup  ^  i  .  f/x  •  F  H  *  1  ’ 

FecTi-lL  U  i’  Yt  Y}  j 

where  X  ■  (Xj  ,  X^ . X^)  is  a  random  sample  from  some  F  eoF. 

This  definition  is  easily  seen  to  coincide  with  the  usual  definition  when  the 
family  is  dominated  by  a  sigma-finite  measure. 

Now  consider  the  problem  of  testing  Hq:  F  e  against  ths  alternative 

a  ^ 

Hj :  F  e  where  c  c?~.  Let  ( F )  denote  the  maximum  likelihood 

estimate  relative  to  t?)  in  the  sense  of  definition  1.  We  define  the 
1  i ke  1  i hood  ratio  statistic  An(X)  based  on  a  random  sample  X  as  follows: 

Definition  2 

A„(X)  is  called  the  iikelihood  ratio  statist ic  where 

f<V  V  f>  1 

1  -  f (X . ;  p0,  f)  • 


We  will  be  concerned  with  the  properties  of  A^(X)  for  various  restricted 

families  of  distributions  c*\  c  <£~  . 

0 

2.  I  FRA  Distr  ibut ions 

Let  <?Q  =  {F  |  F(0)  =  0  and  ~1o3  P“FM]  T  in  x  >  0}  and  X  -  (X, ,  %r 
X  )  denotes  a  random  sample  from  F  .  We  claim  that  the  maximum  likelihood 


m 


mmm 
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estimate  (MLE)  FQ  relative  to  c^~  puts  mass  at  each  of  tne  sample  observations. 

it 

To  see  this  suppose  &  *  {Fj ,  F^}  where  the  Fj  probability  of  the  observation 

Xj  is  Fj  {X. }  >  0  for  i  -  1 ,  2 . n  and  ®  *or  some  ^  ^  <  k  <  n)  . 

From  definition  1  it  follows  that  F,  is  MLE  In  <£“  .  Since  F  *oT  can  put 

1  0 

mass  at  a  countable  number  of  points  we  may  restrict  attention  to  those  F  < cJF 
putting  mas?  at  sample  points;  i.e.,  F  absolutely  continuous  w’th  respect  to 
X  +  p  where  X  is  Lebesque  measure  and  p{A}  equals  the  number  of  sample 
points  in  A  .  The  likelihood  becomes 


l  (x  If)  -  n  F  fx. }  . 
n  “  i-1 


Proschan  and  Marshall  (1967)  have  obtained  the  MLE  under  the  IFRA 
assumption.  From  the  definition  of  IFRA  distributions  we  see  that 


(2.1) 


LnQi  !  F)  =  n  jexp(-  Xj^Xj)  -  exp(-  X f X f )J 


where  0<X  <  X.  <  ...  <  X  .  We  maximize  likelihood  subject  to  these  restrictions 

—  o  —  l  —  —  n 

by  letting  X  ■  0  and  X  -  +®  .  Letting  A  X.  •  X.  -  X.  ,  where  X  ■  0 

o  n  j  j  j  •  o 


and  X  •  +®  ,  we  see  that  (2.1)  becomes 
n 


n-1  r  n  -j 

(2.2)  L  (X  |  F)  -  IT  exp(-  A  X.  I  X.)  fl  -  exp(-  A  X.X.)  ]  . 

n  “  i-1  L  '  i+1  J  1  1  J 


Maximizing  (2.2)  subject  to  AX.  >0(l<i<n)  we  see  that 


6 


Since  h(x) 


*1  ♦  <*,) 

n  —  n 

£  x  r  *(x.) 

j*  i  ■*  j  =  i 


x  (I  -  x)X 


is  increasing  in  x  (0  <  x  <  1) 


it  follows  that 


where  (Yj  <  Y^  <  ...  <  Y^)  is  an  independent  ordered  sample  from  G  .  (2.6) 
follows  immediately  and  the  proof  of  (2.7)  is  similar.  || 


We  say  that  Fj  <  F 2  (i.e.,  F^  is  starshaped  with  respect  to  F2)  if 

FjV^x) 

- —  is  nondecreasing  for  x  >  0  .  From  the  proof  of  theorem  2.1  it  follows 

that  Fj  £  F2  impl  ies 


Hence  the  power  of  the  likelihood  ratio  test  is  greater  at  F?  than  at  F^  when 

F.  <  F.  .  Percentage  points  for  -log  A  (X)  are  given  in  Table  1. 

1  «  2  n  — 

Of  course  there  are  many  unbiased  tests  of  the  IFRA  hypothesis.  Marshall, 
Walkup  ana  Wets  (1966)  have  characterized  the  class  of  all  such  tests.  These  are 
just  the  tests  based  on  functions  f (x^  ,  x2 ,  ...,  ^ )  having  the  properties: 

1)  f  is  homogenous; 

2)  E  x.  af^V  X2 . Xn)  >0  for  j  =  1,  2 . n-1 

i=l  dx.  and  al l 

x,  >  x_  >  . . .  >  x  >  0  . 


if 


The  test  associated  with  f  would  reject  Hq 

f(x,,  X2 . Xn)  >  c 

where  c  is  some  suitable  critical  number  and  X,  >  X.  >,...>  X  are  the 

I  —  2  —  —  n 

usual  order  statistics  labelled  in  reverse  order. 

3*  IFR  Distr ibut ions 

Let  c?~  =  {F  |  F (0)  =  0  and  -  log  fl  -  F(x)]  is  convex  for  x  >  0}  .  This 
is  the  class  of  IFR  (for  increasing  failure  rate)  distributions.  Proschan  and 
Pyke  (1965)  have  proposed  a  test  for  constant  versus  increasing  failure  rate. 

Their  test  is  based  on  a  statistic  considered  by  M.  G.  Kendall  (1938)  and 
H.  B.  Mann  (19^5)  and  is  essentially  a  rank  test  for  trend.  Proschan  and  Pyke 
show  that  their  test  is  unbiased,  has  good  large  sample  properties,  and  is  competitive 
in  this  sense  with  certain  parametric  tests  when  the  unknown  distribution  lies 
within  some  specified  parametric  family.  However,  sampling  experiments  indicate 
that  their  test  does  not  have  good  discriminating  power  for  relatively  small 
samples.  This  is  perhaps  to  be  expected  since  their  test  does  not  use  all  of  the 
information  in  the  sample. 

M.  Boswell  (1966)  studied  a  similar  problem  concerning  Poisson  type  processes. 

His  statistic  based  on  a  conditional  maximum  likelihood  ratio  test  is  essentially 
the  same  as  the  likelihood  ratio  statistic  studied  in  this  section.  The  main 
result  in  Boswell's  paper  is  a  derivation  of  the  asymptotic  distribution  of  his 
test  statistic.  In  contrast,  we  concentrate  on  small  sample  results. 

Since  IFR  distributions  can  have  a  jump  at  the  right  hand  end  of  their 
interval  of  support  it  is  clear  from  definition  1  that  we  need  only  consider 


-i 


JsgSSf 


r  (X . )  ■  n  in  max  ,-  i  ;v - r-  «  ^  ■ 

"  1  v:  1  +  1  u<i  (n‘uMXu+r  Xu,+‘ 


V  -  u 


+  (n-v+1 ) (X  -X 7 
'  V  v-1 


for  i  *■  I,  2 .  n  •  1  ,  The  maximum  likelihood  is 


(3.2) 


Ln(X  I  F)  -  IT  PCX,)  |  e"(n  "  . 


The  exponent  on  e  can  be  easily  verified  using  the  definition  of  r  and  observing 


a.  a .  ! 

n  /*'  n  1  /*l  + 

s,/  r(u)du  ■  <n  - {)  J  f(u)du  • 

1*1  «  1*1  w 


Let  <?Q  *  {F  |  F (0)  -  0,  F (x)  -  1  -  e~X*  for  x  <  T  and  F(T)  *  1  ,  X  >  0,  T  >  0} 

Then  denotes  the  class  of  exponential  distributions  with  possible  truncation 

on  the  right.  Consider  now  the  problem  of  testing  H^1  F  e^T  versus 

H.:  F  e^-  •  The  choice  of  H  was  determined  by  the  fact  that  the  MLE's 

l  o  o 

A  A 

Fq  and  F  are  both  absolutely  continuous  with  respect  to  Lebesgue  measure  in 

[0,  X  )  and  place  mass  at  X  .  The  likelihood  under  H  will  be 
L  n  n  o 


fn-1  I 

L  (X  |  F  )  *  TJ  Xe-XX|  e'XXn 

n  -  0  L  i-1  J 


and  the  maximum  likelihood  will  be 


(3.3) 


I  F'o>  -/V 


According  to  definition  2,  the  likelihood  ratio  statistic  for  testing  for 
truncated  exponent  i  a  lity  versus  1 FR  and  not  truncated  exponent  ial  ity  will  be 


^kt***V: 


if t  ■ 
-*>*• 


(3.4) 


*  /  \ 

\  (*>- 


("  -  ') 

<n  \  n-1  n-1 

IX,)  TT  r(x  ) 

vl  /  1*1 


I n  -  1)(X2-  X})  (n  -  2)(X3- 


<  .. ,  <  1 


Tx  -  x  , 
'  n  n-1 


so  that 


r(X.)  =  t - rr 77 

i  (n  -  i)(X 


i  *  1 ,  2,  . .. ,  n  -  1  , 


i+r  i 


then  (3.4)  becomes 


•k  -k  ,  . 

An  <*> 


n- 1 

TT  (n 

i*i 


i)(X,+,-  X.) 


As  In  section  2  we  consider  the  test,  cp  ,  which  rejects  Hq  when 


a:  (x)  <  c 

n  -  -  cy 


where  c  is  determined  by 
o 


PG  K  (Y)  <  C<>}  =  »  . 


The  asymptotic  distribution  of  A^  (Y)  can  be  found  in  Boswell  (1966,  p.  1572). 
A  table  of  percentage  points  obtained  using  Monte  Carlo  methods  is  contained  in 


Table  2. 


4.  Unbiasedness  of  the  Likelihood  Ratio  Test  for  IFR 


Like  the  Proschan-Pyke  test,  the  likelihood  ratio  test  has  greater  power 


under  the  alternative  than  under  the  null  hypothesis.  To  show  this  we  need  to 
introduce  some  auxilliary  results. 


*SET 


i  CA  'X&HiS  1  j 

t.  .‘‘..'t"?'  ■  r* iV  I  I 


*  kW5»  I 
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n  i 

Given  a  sequence  of  nonnegative  real  numbers  f z . }  ,  plot  E  2,  versus 

!  i-1  1  J 

i  and  interpolate  linearly  between  (0,  0),  (l,  z,),  ...  (n,  z,  +  ...  +  z  )  . 

I  l  n 

Let  Zj  >  >  . . .  >  zn  denote  the  slopes  of  the  least  concave  majorant  to  this 

graph  in  successive  intervals.  This  operation  converts  the  original  sequence  into 

a  nonincreasing  sequence  and  will  be  useful  later  on.  For  convenience,  call 

Zj  >  >  ...  >  zp  the  Brunkized  sequence  after  D.  Brunk  (see  0.  Brunk  et.  al. 

(1955) ^ -  Note  that  z.  >  Z-  >  ...  >  z  can  also  be  obtained  by  successive 

i  —  z  —  —  n 

averaging  of  the  original  sequence  until  it  becomes  non increas  ing. 

We  say  that  H(z,,  z„ ,  . . . ,  z  )  is  a  Schur  function  if 

z  n  —  — -i  i  » 


for  all  vectors  z  and  i,  j  «  1,  2,  ...,  n  .  This  concept  is  needed  in  the 

* 

following  useful  lemma. 

Lemma  1 


/  \  /  \ 

Let  (z,  ,  z„,  ...,  z  )  and  (z,  ,  z_,  ....  z  )  denote  two  nonnegative 
i  2  n  :  i  n 

sequences  such  that 


and 


E  z .  >  E  z  . 

1  1  “  1  1 

n  n  , 

E  z.  =  E  z .  . 

1  1  1  ' 


for  r*l,2,  ...,n-l 


Then  the  inequalities  are  preserved  under  Brunkizat ion; 


j 

1 

J  | 

i 


f:  4  f  i  >*•■ 

Rfc 

J.r-  /  ,  -  '*a<-  ■' 

* 

•\  * 

fe&r'  'r  .  •  * 

E^vH  *V'*‘  v''  ’  v^L 

^  v^;  -  •,  *? 

'"*  •'*  _ 


i  •  c  •  y 


(i) 


z  z.  >  z  z. 


i=i 


i=i 


(r  =  1  ,  2 ,  ....  n  -  1) 
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E  z.  -  Z  z. 


i=1 


i  =  l 


If  H  Is  a  Schur  function  then 


—  —  —  I  I  I 

(ii)  H(Zj  ,  z2>  ....  zn)  >  H(zj ,  z2,  ...,  z^) 


Proof: 


(i)  is  obvious  since  the  least  concave  majorant  to  the  fz.)  sequence 

i 

lies  above  the  least  concave  majorant  to  the  {z.}  sequence. 

_  _  _  “T  *T  "  _  n  — 

Since  (i)  holds,  z.  >  z„  >  ...  >  z  *,  z,  >  ...  >7  and  Z  z.  *  Z  z. 

i  —  Z  —  —  n  1—  —n  |  i  |  i 

we  have  (ii)  by  the  Schur,  Ostrowski  theorem  (see  Ostrowski  (1952)).  // 


Theorem  k.  1 


.-1. 


If  G  F(x)  is  convex  for  x  >  0,  G ( 0 )  =  F(0)  =  0  and  X  (Y)  denotes  a 
random  sample  from  F ( G )  ,  then 


a“  (X)  <  a"  (y) 

n  -  -  n  - 


Remark 

This  proves  the  likelihood  ratio  test  A  is  unbiased  since  if  F  is  IFR 
-x  -1 

and  G (x)  =  1  -  e  for  x  >  0  ,  then  G  F  is  convex  on  x  >  0  . 


1  I 


Proof: 


Let  Y*=G'1F(X.)  and  note  Y*-Y.  . 


.. a  a: .  --  Tfr-  . . . 


2  . 

J _ 

r 

F  z 

i  i 


n-I  , 
T  z. 
I  ' 


—  n- J 


F  z. 


■  i  i 

and  hence  Fz.>Izforr-i9  ,  ~r 

]  1  “  l  !  ’  2 .  n  -  1  •  Let  fz. }  and  fz.  )  denote 

Brunkized  estimates  of  fz . }  and  fz!) 


the 


respectively.  Let 


n-1 


“H(xj  »  x2  ,  . . .  ,  xn  ,)  =  77 


n-1  ‘ 


x . 


i  =  l 


and  note  that  H  is  a  Schur  functior 
hypotheses  oi  lemma  1,  it  follows  that 


Since  fz.}  and  fz! }  setisfy 


the 


1 


f-.V/M-.  r 

,  \*s8fc. 


m*  m  • 


site 

feLt*.  •  v*  •-■■’■  ■  v 


Hence 

(4.1) 


-  H(z1  ,  z2>  •  •  •  >  zn  ^ )  <-_H ( z  ^  ,  Zji  •••>  j )  . 


n-1 
T.  (n 
1 


i)(X.„-X.) 


n-l 

IT  ?<x.) 

i 


I 

n-l 

I  (n-i ) (Y."Y V ) 
1  11  ' 


n-l  n-I 

IT  P(Y‘ ) 

i  1 


Since 


•+r 

YV) 

r  y-: 

.  1  1 

i+r 

x.) 

i 

—  n 

r  x. 

l  1 

for  (1  <  r  <  n  -  l)  by  lemma  3-7  ( J ' )  of  Barlow  and  Proschan  (1966)  it  follows  that 
n-l  n-l 


(4.2) 


l-l  n-l 

T.  (n  -  i)(Xj+1-  X.)  I  (n  -  i)(Y,  +  r  V.) 

J -  <  _J - 

n  —  n 


(4.1)  and  (4.2)  together  imply 


The  theorem  fol lows  from  (Y, ,  Y. ,  ...,  Y  )  =  (Y.,  Y, ,  ...,  Y  )  .  // 

I  I  n  s  t  i  l  n 


Marshal  1  ,Wal kup  and  Wets  (1966)  have  characterized  the  class  of  unbiased 
tests  for  constant  failure  rate  versus  nondecreasing  failure  rate.  These  are 


based  on  functions  h(x.,  x0 ,  ...,  x  )  satisfying  the  conditions 

14  ft 


■  ,;  J,r  . 


i)  h  is  homogeneous i 

j  ^h  ( x . ,  .  »  •  ,  x  ) 

ii)  Z  (x  -  x  )  - — - —  >0  j  *  I,  2,  ...,  n  -  1 

i  =  l  1  J  1  dxi 


for  all  xi  >  x2  >  •  •  •  >  xn  >  0  .  The  corresponding  test  consists  of  rejecting 

exponent ia 1 i ty  if  h(X  ,  X  ,  X  )  <  c  where  c  is  a  suitable  critical  number 

I  L  n  — 

and  X,  >  X  >  . .  „  >  X  are  the  order  statistics  labelled  in  reverse  order. 

I  —  2  ■  —  n 

5-  Distribution  of  the  Maximum  Likelihood  Ratio  Statistic  Under  the  Exponential 
Assumpt ion 


From  the  computat  io.is  in  Boswell  (1966)  it  is  clear  that  the  distribution  of 

Vc 

An  ,  even  under  the  null  hypothesis,  is  exceedingly  complicated.  For  this  reason 
we  have  had  to  use  Monte  Carlo  methods  to  obtain  the  percentage  points  tabulated 


i n  Table  2. 


as  we  show  in 


However,  the  distribution  of  A  under  H  is  quite  smooth 

n  o 


Theorem  5*  1 


The  likelihood  ratio  statistic  A  has  a  non i ncreas ing  density  on  (0,  1) 

n 

under  the  exponential  assumption. 


Proof: 


Let  0  *  W_  <  W.  <  ...  <  W  denote  an  ordered  sample  from  the  uniform 

-  0  —  1  —  —  n 

distribution  on  (0,  1)  .  Let 


U.  =  W.  -  W.  i=l,2,...,n-l. 
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Then  the  random  vector  (U. ,  Up  ....  un_j)  has  Jomt  density 


(n-1 ) i  for  u .  >0 


h(u^ ,  »  • » • »  un_] ) 


i  s  1  ^  2 ,  •••>  n  ■  J 

0  5  U1  +  U2  +  ***  +  Un-1  -  1 
otherwise. 


Let  (Uj ,  Uj »  ••  •  »  Up  j)  denote  the  modified  vector  (Up  Up  •••»  Un-1^  after 

Brunkization  and  subject  to  U,  >  U2  -  *  *  *  -  Un-1  * 

The  likelihood  ratio  statistic 


i 


n-l  n-1 


IT  r(V.) 


is  distributed  as  (n  -  I)""'  IT  under  the  exponential  assumption.  Notationally 

it  Min  be  convenient  to  replace  n-1  by  n  .  Hence  we  need  only  prove  that 


P  ITT  U.  <  z 


i  =  l 


is  concave  in  z  c 
observe  that 


(0,  1)  .  Let  I  denote  the  usual  indicator  set  function  and 


IJv*)  1  r“'  -“-2]du’  -d“"  ■ 


0<Uj+.  .+un<l 


•  •  ?  •  ^  n '  - 
;■  v  %-  .'  ;/{(■  fj1  M ->- s'  Ml 

,.,w 


’•W  .’V**-'  *  *•«  .  ■’flp-J-  -. 


.w  *#«  cfJlpy*-  ‘ 1  *'\* 


Integrating  out  on  u  we  have 

n 


p!lTU:£2j  -n  -ff  J  f  (u^ . un_2;  z)du^  . . .  dun 


U.+...+U  ,<1 

1  n-1— 


whe  re 


f(uj . un  J;  z)  =  /  I  fuj..^  <  z]dun 


0<u  <1  -u.  -. . .  -u  , 
-  n-  1  n-1 


min  [l  -  u.  -  ...  -  u  u  (z) ] 
1  n-1  n  J 


and  u  (z)  is  the  solution  of  z  *  u.  ...  u  ,  u 
n  I  n  - 1  n 

for  fixed  u. ,  u„ . u  . 

12  n-i 

We  claim  that  z  is  a  strictly  increasing  convex  function  of  un  and, 
therefore,  that  un  is  a  strictly  increasing  concave  function  of  z  .  It  follows 
that  f(u,,  ...,  u^  , ;  z)  is  a  concave  funct.on  of  z  for  fixed  (u^  ,  u? ,  ,) 


Hence 


|ftui  -  zj  “  f(v 


...,  u  * ,  z)du,  ...  du  * 
n - i  i  n- l 


U.  +  ..+U  .  <1 

n  - 1  — 


is  a  concave  function  of  z  . 

To  show  z  ■  u,  . . .  u  ,u  isa  convex  function  of  u  ,  define 
1  n-1  n  n 

JU  J. 

(u. . u  .)  to  be  the  Brunk  modification  of  (u, ,  u  ,  u  ,)  subject 

l  n-l  l  2  n-1 

_*  _*  _*,v 

to  >  u^  >  . . .  >  u^  j  .  Clearly  z  is  piecewise  convex  for  un  in  the 

intervals  fO,  u*_2],  [u*_2>  u^],  ....  [1  -  u* . u*_1 ,  u*]  .  It  is 

therefore  sufficient  to  show  that  z  has  a  continuous  derivative  in  u  .  We  show 

n 

.*  ,  _  -* 

that  the  right  and  left  hand  derivatives  at  un  ■  un_1  are  equal.  For  un  <  un_^ 


»  *4. 


P0m. 

Lte»rW'  ■1?l|r'.)l  l  , 

l  m 

-  .  ’  A.  * 

I-  :  *■■ 


-:,  ^/W” +Vl\  B-J*' 

U1  •"  “j  l  n-l-j  / 


For  u  .  <  u  <  u  , 
n-1  n  n-z 


.  .  / u.^,+. • *+u  \  n"J "1 

dz  -*  -*  I  i+l  n\  J 

- —  *  u.  ...  u.  I—1 - : - 1 

du  1  J  \  n-j  / 


For  u  *  u  ,  »  obviously 
n  n  - 1 


For  n  *  2  and  n  =  3  it  is  a  straightforward  computation  to  obtain  the 


distribution  of  a"(Y)  .  Clearly,  for  n  =  2 
n  — 


i£(  V) 


and  the  likelihood  ratio  is  uniformly  distributed  on  (0,  l) 


For  n  *  3 


A^Y)  =  4  U,  U2  = 


4  U1  ^ 

(u,  +  u2)- 


if  U1  >  U2 


if  u,  <  u2  . 


Hence 


pg|^(I)  < u 


*  // 2  du  du  +  //  2  du,  du2 

(u]u2—  Z+ )  (Ul+U2-  ^  ) 


V  U2 


Ul±  U2 


<  uj  -  $  ♦  i  -  [-09  *  ( 


1  -  y/T-u 
2 


-JL^.i...  . . 
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The  density  is 

9j(«)-i+i  log^^^l  . 

It  is  easy  to  check  that  g  is  decreasing,  g  (0)  -  +  •,  g  (l)  -  \  and 

'  i 

93 (°)  =  9^(1)  =  -  ®  ..  it  is  tempting  to  conjecture  that  this  behavior  is  true 
in  general  ,  i  .e.  ,  gn <C)  =  +  <*,  gn (0)  «  gR ( 1 )  -  -  *>  for  n  >  3  . 


’r**~***t»i*  Miis'yw. 


TABLE  2 

Percentage  Points  for  the  I FR 

Likelihood  Ratio  Statistic  A  ( Y ) 

n  — 


20a 


t 

A 


'•i 


Sample  Size 
n 

Percei 
■  05 

it i les 
.01 

Number  of  Random 
S;mulations  Used 

2 

.0500 

.0100 

50,000 

3 

.025 

.004 

50,000 

4 

.0162 

.0027 

40,000 

5 

.0125 

.0017 

50,000 

6 

.01 

.0015 

60,000 

7 

.0087 

.001 

60,000 

8 

•  0077 

.001  1 

80,000 

9 

.0065 

.0007  : 

70,000 

10 

.0055 

.0007 

50,000 

BLANK  PAGE 
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6 .  Comparisons  with  Competing  Tests 

In  a  paper  in  process  (Barlow  and  Jacobson)  we  study  in  some  detail  the 

robustness  of  the  IFRA  and  IFR  likelihood  ratio  tests  relative  to  selected  competing 

tests.  Preliminary  investigations  indicate  that  the  IFR  likelihood  ratio  test  is 

much  better  than  the  Proschan-Pyke  test  for  small  samples.  However,  they  have 

achieved  a  remarkable  amount  of  information  concerning  the  asymptotic  behavior  of 

their  test  statistic.  In  particular  they  show  that  their  test  statistic,  suitably 

normalized,  has  an  asymptotic  normal  distribution  for  a  wide  class  of  alternative 

distributions.  On  the  other  hand,  the  distribution  of  the  IFR  likelihood  ratio 

2 

statistic,  under  the  null  hypothesis,  converges  to  a  weighted  sum  of  X  distributions 

which  is  rather  cumbersome  to  compute.  For  small  sample  sizes  (say  n  <  10)  both 

statistics  are  relatively  easy  to  compute  with  the  aid  of  a  desk  calculator. 

Figure  1  is  a  graph  of  the  power  functions  for  both  tests  against  Weibull 

■(  X*  )^" 

distribution  alter nat i ves  ( i  . e .  ,  F(x)  =  1  -  e  for  x  >  0  where  a  i s 

the  shape  parameter)  when  the  sample  size  is  10  and  the  significance  level  is 

5%.  These  curves  were  obtained  by  nuans  of  Monte  Carlo  simulation  on  a  computer. 

The  power  of  the  Proschan-Pyke  test  increases  very  slowly  as  a  function  of  the 

Weibull  shape  parameter,  a  .  Even  when  the  shape  parameter  <y  =  3  •  the  power  is 

only  .62.  Our  numerical  i nvest i ga i ons  indicate  that  for  o  >  3  the  power  increases 

even  more  slowly  and  that  for  p  =  500  ,  the  power  is  only  .86.  For  n  =  20  , 

the  power  of  the  Proschan-Pyke  test  is  much  better;  it  yields  a  power  of  .92  for 

fy  =  ?  .  It  should  be  noted,  however,  that  the  power  of  this  test  is  still  not  as 

good  as  the  power  of  the  likelihood  ratio  test  when  n  =  10  . 

The  asymptotic  relative  efficiency  of  the  Proschan-Pyke  test  relative  to  the 

Weibull  likelihood  ratio  test  when  the  true  distribution  is  of  the  form  G(x)  = 

-(x)0' 

1  -  e  (o'  >  1 )  for  x  >  0  was  computed  to  be  .59  (see  Proschan-Pyke  (19&5)). 


The  asymptotic  relative  efficiency  of  their  test  relative  to  the  gamma  likelihood 


22 


ratio  test  when  the  true  distribution  is  the  gamma  is  only  .20.  Unfortunately, 
asymptotic  evaluation  of  the  IFR  likelihood  ratio  test  seems  to  be  extremely  difficult. 

There  are  many  additional  unbiased  tests  of  exponent i a  1 i ty  versus  IFRA  or 
IFR  which  should  perhaps  be  considered.  Recall  that  all  of  the  associated 
statistics  are  necessarily  homogeneous.  A  statistic  related  to  the  IFR  likelihood 
rat io  stat  i st ic  is 

n 

IT  (n  -  i  +  1)  (X  -  X.  )  . 

j:  | 

If  there  are  no  reversals  of  the  normalized  differences  (they  should  decrease  under 
IFR  alternatives)  then  and  A  agree  except  for  the  factor  n  X^  and  a 

constant.  If  G  '  F  is  convex,  then 

C  w  i  c  (i)  • 

St 

The  test  which  rejects  exponent  i  a  1  i  ty  when  An  (X)  is  sufficiently  large  is  related 
to  a  test  derived  by  Moran  (1951)  for  a  problem  concerning  renewal  processes.  Under 
the  assumption  of  exponent i a  1  i  t y 

-2  log  A  '  ( Y) 

W  =  — : - v - 

1  +  n+l 

2 

is  asymptotically  distributed  as  a  X  variable  with  n  -  1  degrees  of  freedom. 
Epstein's  (i960)  test  8  uses  this  statistic.  Monte  Carlo  experiments  by  Ztlen 
(1961)  indicate  that  the  power  of  this  test  is  less  than  that  of  the  Proschan -Py ke 
test  for  small  samples  against  Weibull  distribution  alternatives. 

In  section  2  we  proved  that  F  <  G  implies 


r 

/. 


ft 


(X)  >  A  (V) 

-  -  n  - 
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i 

| 


Hence  we  could  consider  the  test,  c  ,  which  rejects  exponent  ia 1 i ty  in  favor  of 

the  IFRA  hypothesis  when  A  (X)  >  c,  where 

n  —  —  l-o 


An(i> 


For  this  test  we  would  use  the  upper  percentile  points  of  -log  A  (X)  given  in 

Table  1.  Since  A  (X)  is  essentially  the  maximum  likelihood  under  the  IFRA 

n  — 

assumption  it  is  perhaps  not  too  surprising  that  it  seems  superior  to  the  IFR 
likelihood  ratio  test  (see  Fig.  l).  On  the  basis  of  computer  calculations  we 
conjecture  that  -log  A  (Y)  ,  suitably  norma  I  i  zed,  i  s  asymptot  i  ca  I  I  y  N  ( 0  ,  l)  . 

Perhaps  a  better  test  than  all  of  those  considered  so  far  is  a  un i form 
conditional  test  [see  Cox  and  Lewis  (1966)  p.  153]  based  on  the  mean  of  the 
rectangular  distribution.  This  has  been  described  by  Bartholomew  as  the  oldest 
known  statistical  test  ^see  discussion  in  Cox  (1955)]-  Epstein  (’960)  adapted  this 
test  to  the  life  testing  problem  and  called  it  test  3-  The  test  is  based  on  the 


total  time  on  test  up  to  the 

i -th  order  statistic  (i  =  1 

,  2,  . 

■  •  ,  n)  , 

i  .  e 

T  (X.)  = 

i 

Z  (n  -  j  +  I)  (X.  -  X  )  . 

1  —  1  J  J  ~ 

J~  ' 

n  - 1 

n 

The  test  statistic  is  Z  T(X.)/  Z  X.  .  Under  the  exponential  hypothe  is 

i=l  '  1  ' 


Z 


n  - 1 

Z  T (X  . ) 


(n-1 ) 
2 


n 

Z  X. 

i  i 


Z  X.  /(n  -  1)/12 


IVJV! 


TT7 


'!Wi 


2*4 


is  approximately  N(0,  l)  even  for  relatively  small  n  .  If  F  <  G  ,  then  it 
follows  from  Theorem  3-12  (iii)  [Barlow  and  Proschan  ( 1 966 ) 1  that 


n  - 1  n-1 

ET(X.)  £  T(Y. ) 

I  '  .  1  ' 

-  ^ - 


n  -  n 

EX.  s  C  E  Y . 

I  1  1  1 


Hence  a  natural  test,  cp  ,  rejects  exponent  i  a  1  i  ty  in 


favor  of  I  FRA  i  f 


n-l  T (X  . ) 


E  X. 


>  c 


n-l 


n 


where 


P_  E  T(Y. )/  E  Y.  >  c  =  v 

G  I  I  1  1  1  "  " 


Empirical  sampling  by  Zelen  and  Dannemiller  [(i960,  p.  V]  indicates  that  this 
test  is  superior  to  cp  against  Weibull  distribution  alternatives.  Investigations 
by  Cox  (1955)  show  that  the  analogue  of  this  test  for  randomness  in  a  sequence 
of  events  is  the  most  powerful  test  of  the  Poisson  hypothesis  against  the  alternative 
of  a  time-dependent  Poisson  process  with  occurrence  rate 

Mt)  -  e^61  . 

See  Bartholomew  (1956)  for  further  results  concerning  this  test. 

7 .  Concluding  Remarks 

It  is  perhaps  worth  noting  that  the  percentage  points  in  Table  2  and  the  results 
of  section^  also  apply  to  the  Boswell  test  for  trend  in  a  stochastic  process  of 
Poisson  type.  However,  if  the  sample  size  is  n  and  one  is  using  the  Boswell 
statistic  then  one  should  locate  percentage  points  in  Table  2  corresponding  to 


. -I-  "im  -  -- 
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the  number  n  +  1  .  A  proof  for  unbiasedness  of  the  Boswell  test  can  be  made, 
patterned  after  the  techniques  of  section  k. 

The  number  of  possible  likelihood  ratio  tests  which  may  be  constructed  using 
the  definitions  in  section  1  is  fairly  large.  Recall  that  the  DFR  (for  decreasing 
failure  rate)  maximum  likelihood  estimate  is  absolutely  continuous  when  F(0)  =  0 
Marshall  and  Proschan  (1965)  Hence  one  can  construct  a  likelihood  ratio  test 
for  the  following  proolems: 

H„ :  F  a  truncated  exponential 
/  .  \  0 
( 1 )  versus 

H  F  DFR  anc  then  IFR  (F(0)  =  0) 


versus 

H  F  DFR  and  then  IFR  (F (0)  =  0)  . 

Note  that  the  maximum  likelihood  estimates  under  both  the  hypothesis  and  the 

alternative  in  each  case  will  be  absolutely  continuous  except  at  the  largest 

observation,  X  ,  if  we  impose  the  additional  restriction  F(0)  =  0  . 
n 

Clearly  we  can  also  construct  a  maximum  likelihood  test  for 

H  ■  F  truncated  DFR 

(3)  versus 

H| :  F  DFR  and  then  IFR. 

There  is  no  difficulty  in  constructing  maximum  likelihood  tests  for  the  problems: 


(M 

Ho: 

versus 

F 

exponent i a  1 

V 

F 

DFR  (F(0)  =  0) 

and 

(5) 

V 

versus 

F 

DFR  (F(0)  =  0) 

H,: 

F 

has  decreasing  density  ( F ( 0 )  =  0) 

and  F  not  DFR 
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The  maximum  likelihood  estimate  assuming  a  decreasing  density  is  given  by  Grenander 
(1956).  Recall  that  if  F  is  DFR,  then  it  has  a  decreasing  density. 

Likelihood  ratio  tests  for  the  twc  sample  problem  will  be  considered  in  a 
subsequent  paper. 
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